Duration of violation of the second law of thermodynamics along a single trajectory in 

phase space 



Reinaldo Garcia-Garcia* and Daniel Domi'nguez 
Centra Atomico Bariloche and Instituto Balseiro, 8400 S. C. de Banloche, Argentina 

We study the fraction of time tliat a system spends violating the second law of thermodynamics 
within a single trajectory in the phase space under driving at a constant rate. We denominate 
this quantity as violation ratio, and we denote it by TZ-{N,t) — T-{N,t)/t, where T-{N,t) is the 
amount of time the system has violated the second law up to time f in a system with A'^ particles. 
We develop general arguments to predict that for generic ergodic systems its mean value scales, in 
the large-t - large-A'^ limit, as {TZ-{N,t)) ~ (t\/iV)~^. We determine, for a simple system driven 
at a constant rate, the precise asymptotic behaviour of the mean violation ratio, both, analytically 
and numerically, showing a good agreement with our prediction. Finally, we briefly discuss how this 
simple scaling may break down in the vicinity of a phase transition. 

PACS numbers: 05.40.-a,05.70.Ln 



Fluctuations in small systems induce violations of the 
second law of thermodynamics for arbitrary external pro- 
tocols at individual trajectories. This fact is well charac- 
terized, in an ensemble-based picture, by the celebrated 
fluctuation theorems [1-6]. In this picture, the relative 
probability weight of those trajectories not violating the 
second law with respect to those violating it, is computed. 
This relative weight exhibits a simple form 



PjX) 



exp(X), 



(1) 



where T represents a transformation, usually time- 
reversal, or a transformation to a dual dynamics (see [7- 
9] for a simple definition of the dual dynamics), and X 
represents a trajectory-dependent thermodinamic quan- 
tity, as work, heat, or more generally, different forms of 
trajectory-dependent entropy production, possessing the 
symmetry X"^ = —X. 

In the last few years, these relations have been ex- 
tended to non-Markovian dynamics as well [10-16], and 
a lot of experimental work has been done, on one side, in 
order to test their validity in given systems, and on the 
other side, in order to use them, for example, to recon- 
struct the free energy landscape of small systems (see for 
instance [18-22]). 

Eq.(l), which is commonly denominated a de- 
tailed fluctuation theorem (DFT), leads to the relation 
(exp(— X)) — 1, also known as an integral fluctuation 
theorem (IFT). From the IFT, the second law of ther- 
modynamics can be immediately derived as {X) > 
whatever the protocol and the duration of the process 
are. In very large systems the fluctuations are naturally 
supressed and {X) « X. Then, for any realization of 
any process one has X > 0. However, in small systems, 
fluctuations play an important role and realizations are 
possible such that X < for not too large times. As pre- 
viously stated, fluctuation theorems (FTs) express that 
these "second-law-violating" trajectories have an expo- 
nentially small weigth related to trajectories being com- 



patible with the second law of thermodynamics. 

One may wonder, however, if it is possible to char- 
acterize the way a system violates the second law from 
a different perspective. For instance, one may formu- 
late the questions: Within a particular trajectory in the 
phase space, what amount of time (or what fraction of 
time) the system spends in the "violation sector" defined 
by X < 0? How does this fraction vanishes for large 
times and in the thermodynamic limit? In order to ad- 
dress these issues, we need to study the zero-crossings 
properties of the stochastic process X{t). In particular, 
we should note that the amount of time, up to time i, 
that a process spends in the semi-space X{t) < (or 
X(t) > 0), is called by the comunity of stochastic pro- 
cesses physicists as a "residence time". The probability 
density function (PDF) for this quantity is closely related 
to persistence, e.g. the probability that the process does 
not cross the line X = up to time t [23]. This quan- 
tity have been studied in many different contexts. For 
example, in [23, 24] it have been used to characterize the 
ordering dynamics of the Ising model (where the process 
X{t) is just the global or local magnetization). 

Generally speaking, the computation of the full PDF of 
the residence time for a given stochastic process is a com- 
plex task, even is the process is Markovian. In our case, 
we choose X to be an stochastic entropy production (see 
definitions below) which is non-Markovian even if the sys- 
tem performs Markov dynamics. Thus, an exact determi- 
nation of the full PDF is out of order. We rather derive 
some results for the first moment of this PDF, the aver- 
age violation ratio, defined as {TZ^{N,t)) — {T_{N,t)) /t, 
where T^{N,t) is the amount of time, up to time t, that 
within a given trajectory for the system with N particles, 
X{t) was negative. 

This kind of study may be relevant in some practical 
situations. For typical processes, violations of the second 
law of thermodynamics occur at very short times (thus, 
introducing a typical time scale related, of course, to the 
mean time the system spends in the sector of negative 



2 



X). Then, typical operation times of devices intended 
to work avoiding these effects should be greater than the 
introduced time scale, thus, there is a well defined limit 
for miniaturization, which can be properly determined 
by means of this kind of study. 

In this letter, we consider generic ergodic and exten- 
sive systems driven by a set of external, well controled 
parameters (which we denote by t{t)), varying at con- 
stant rate. For constant protocols, the system is able 
to reach a unique steady-state characterized by the PDF 
Ps{C\€} = exp[— (/)(C; €)], where C denotes a configura- 
tion in the phase space. C may be a single variable, a 
vector, or a field as well. We discuss equilibrium and 
non-equilibrium steady-states (NESS) on the same foot- 
ing. Furthermore, we assume that the system is initially 
prepared in the steady-state corresponding to 1{Q) = Iq. 
We introduce the process X{t) as follows 



X{t) = / dsi{s)d,^{C{s);e{s)), 



(2) 



which depends on the particular trajectory of the sys- 
tem in the phase-space during its evolution. For equi- 
librium steady-states, this is no more than the total en- 
tropy production, proportional to the dissipated work [6] 
pyVd = /3W - /3AF, where W is the thermodynamical 
work introduced by Jarzynski [5], whereas F is the free 
energy. On the other hand, for NESS, this quantity cor- 
responds to the functional of Hatano and Sasa [25], which 
is the correct choice in order to extend the second law of 
thermodynamics to NESS. 

We start by advancing some fundamental results. For 
the generic kind of systems we are considering, the mean 
violation ratio exhibits, at large times, the simple be- 
haviour {n-{N,t)) - A{N)/t, where AiN) is a model- 
dependent function of N which vanishes in the thermo- 
dynamic limit as A{N) ~ Aoo/V^, with Aoo a non- 
universal, model-dependent constant. We remark that, 
even if these results are very intuitive, we were not able 
to find them in the existing literature. We develop a gen- 
eral argument for ergodic systems in order to justify such 
a scaling law, and we test it in a simple Gaussian system 
both, analytically and numerically. 

Let us begin by considering an ergodic system initially 
prepared in its steady state corresponding to a value of 
the parameters ^(0) = £o. We should note first that er- 
godicity has two important consecuences: i) the system 
satisfies the IFT (Jarzynski [5] or Hatano-Sasa [25]) 



(exp(-X)) = J dXP{X,t)exp{~X) = 1, 



(3) 



and a) in the large- iV limit, the probability density func- 
tion of the extensive quantity X becomes a Gaussian 



PiX,t) 



v/2^Sx(i) 



exp 



{X-mx{t)y 



where mx is the mean value of the entropy production, 
while Ex coresponds to its variance. Non Gaussian cor- 
rections should be subleading in as — t- oo. However, 
some care has to be taken in order to take this limit when 
combined with the FTs as pointed out in [26], since the 
IFT (exp[— X]) = 1 is strongly influenced by rare trajec- 
tories contributing to the tails of the X-PDF, where the 
central limit theorem is weaker. We consider here the 
class of systems for which both, the fluctuation theorem 
and the Gaussian character of the fluctuations of X hold. 
Then in the large- limit we have ^x{t) = "^mxit), as 
can be easily seen by direct substitution of (4) in (3). 

The second important point to note is that, for very 
short times, the mean entropy production per particle 
behaves as nxit) = 5/ix(0)i^-l-O(t^). This result follows 
from the fact that mx(0) = and mx(0) = 0. The first 
relation may be easily seen by using the definition of 
the entropy production X(t). The second relation can 
be obtained by differenciating in (2), taking the average 
and having in mind that the system, at i = 0, is prepared 
in its steady-state. 

Third, for generic processes the mean entropy produc- 
tion should increase with time. In particular, we con- 
sider protocols such that mx (t) is an strictly monotonous 
growing function (as it is the case for constant driving). 
Note that in this case, the system is able to violate the 
second law of thermodynamics only within a time sector 
where the mean entropy production is smaller than the 
standard deviation associated to the X-distribution. For 
larger times, as nix increases, fluctuations are not strong 
enough to make X negative. We denote this characteris- 
tic time by Tc{N). Thus, for t > Tc{N), the average time 
the system spends violating the second law does not in- 
crease: 



(r_(i > Tc{N))) = const < Tc{N). 



(5) 



This means that we can write (r„(t > Tc{N))) — A{N), 
with A{N) = a{N)Tc{N), and a{N) < 1 a constant that 
depends in principle on the number of particles, the spe- 
cific protocol and on temperature. We then have 



{TZ-{N,t > rj) ^A{N)/t 



(6) 



The previous argument explains the behaviour 
{TZ^{N,t)) ^ t^^, and also gives a precise mean- 
ing to the phrase "large times". Now, note that, as 
discussed before, the violation sector is defined by the 
relation mx(t) < \/2I]x(i), which leads to mxit) < 4 
using the derived relation between the mean and the 
variance of the X-PDF. Then Tc{N) is determined 
by the relation mx{Tc) = N^x{tc) ~ 4, leading to 
f^x{Tc) ~ ^- Note that if N is large enough, then Tc 
should be small. Thus, one can use the expansion of nx 
(4) around ^ = 0, to obtain Tc{N) ~ , , which means 

^/Njix{0) 
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that we can write, to the leading order in t and N 



WN 



(7) 



with Aoa — ^/^"°° , and — a(N oo), which we 

assume finite. Equation (7) constitutes the main result 
of our work. In order to test it, we consider a discrete 
model of an elastic line where particles interact via a 
short-ranged elastic potential in the presence of periodic 
boundary conditions (PBC). Besides, the system is cou- 
pled to a parabolic trap. The center of the trap will be 
considered here as our external protocol. The Hamilto- 
nian of the system is given, as usual, by 



N 



N 



n{{u}.r,e) = ^K+i - + - - if, (8) 

1=1 4=1 

where k denotes the strenght of the trap. It is simple to 
see that for the present system the free energy does not 
depend on i, thus one has Wd = W. For the work, the 
relevant degree of freedom is the position of the center of 
mass of the chain 



WK,^{s);i{.s)]^kN dsiisMs) - u^^s)], (9) 
Jo 

a result which follows by particularizing the general defi- 
nition given in [5] to our case. The center of mass evolves 
as 



(10) 



where the effective noise 77 (t) has zero mean and vari- 
ance {'ri{t)'q{t')) = -^5{t — t'), if one assumes simple re- 
laxational Langevin dynamics for the system at inverse 
bath temperature (3. As can be seen, the center of mass 
moves like a particle interacting with a thermal bath equi- 
librated at the inverse temperature PcsiN) = j3N . Then, 
for constant i{t) = I, the equilibrium distribution corre- 
sponds to 



Poq(Mcm,^) = exp 



P[ \Nk{u,^-if^F{p) 



(11) 



where F{P) can be determined by normalizing 
Pcq(ucm,^)- As our systcm is initially prepared in equi- 
librium, and by virtue of the previous discussion , we 
conclude that the work is a Gaussian process. We are 
interested in the case where the center of the parabola 
starts to move at a constant speed i{t) = 1^ + vt. Then, 
simple calcultions lead to the results m\^{t) = (>V(t)) — 
Niiw{t), and Ew(i) = ((WW - mw(i))') = |iVAiw(i), 
where /iw(0 the average work per particle 



vH- 



k 



[1 - exp(-/c<)]. 



(12) 



With all this, the work PDF can be immediately written 
as a Gaussian of the form (4). 

Now, we are in position to explicitly calculate the mean 
violation ratio 

{n.{N,t)) = \ j\s{Q{-W{s))) ^ 

^ - f ds [ dWP{W,s). (13) 

It is easy to see, from Eqs.(4) and (13), that for large t one 
has, to the leading order, that {U-iN, t)) ^ A{N, v, 13) /t 
for t 00, with 

A{N,v,P)^]^j^ ErfcQv//?iVA*w(s))ds. (14) 

We are interested in the large N limit. In this case we 
can see, using (12), that to the leading order in 1/VN 
we have 



A{N,v,/3) 
implying that 



^= / Erfcf s 
2VN Jo V 



ds 



Trl3kv^N' 
(15) 



(7^_(iv,^)) 



; t ^ oo,N ^ 00, (16) 



where Aoo does not depend on t nor N. 

We also perfomed some numerical simulations. Let us 
introduce the variable y(t) = £(t) — Ucmit). In a time 
discretized picture, this new variable evolves as 



Vn =Vn-l- (kyn- 



v)At 




(17) 



where ^„ is a random variable (for each n) such that 
((^„) = 0, and (Cn) = 1- We use a time step At = 0.005. 
We first thermalize the system at i;o = during 50000 
time steps and then we start to pull the parabola at 
a finite velocity v during a lapse of 20000 steps and 
compute the work at every time, and also the value of 
TZ-{N,t). Each 200 steps (after the thermalization pro- 
cedure) we save this quantity in order to compute its 
average. The work for each time step can be easily cal- 
culated as W„ = yVn-i + kNvAtyn-i- 

Introducing the quantity /„ being one if the work is 
negative, and zero otherwise we have, using the gen- 
eral definition of TZ-{N,t), that one can write TZ 



-fn-i- If we introduce the scaling vari- 



n-l -Tp(»-l) 
n 

able A = WN, we should have, for large t and N, 

that ^J^^{^Z-{N,t)) = G(A). We set /3 = 0.05, 
V — 1.0, k — 1.5 and study different system sizes, say 
iV = {2^, 26, 2«,2i", 212,214,216}. For large N, we find 
a very good agreement (see Fig. 1) with the expected 
scaling form G{X) = X~^. 
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Scaling form of the mean violation ratio 
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FIG. 1. (Color online) Scaling form of {7^_(iV, t)) in the elas- 
tic system. For large N, the law given by Eq. (16), with 

Aoc = ^ is verified. 

To finish, we discuss a simple case where the obtained 
scahng law may fail. First, let us write a more detailed 
expression for rhx{0)- Note that taking £{t) = £o + vt we 
can write at short times 

{d,<l>{C{t),£m « {de<j>{Cit)Jo)) +vt{djcj,{C{t), £o))ss, 

(18) 

where the double-s subscript means that the average is 
taken in the steady-state corresponding to £ = £q. On 
the other hand, to the same order, the normalization 
condition for the steady-state PDF leads to the relation 
(9^0(C(t), ^o))ss = C'r(O), where the correlation function 
Cr is given by 

Cr{t-s) = {decf,{C{t),£o)decl>{C{s),£o))ss (19) 

Also note that using the generalized fluctuation- 
dissipation relation (see, for instance, [27]) one can write 

{di(t>{C{t)Jo)) f dssx{t-s), (20) 

with x{t — — dtCr{t — s). With all this, using (2), we 
have 

mx{t)^v^ I dssxit- s) + v^tCr{0), (21) 
Jo 

at short times, leading to the result rhx{0) = v^Cr(O). 
Assume that our system has linear size L, being large, 
but finite, and that we are in the vicinity of a phase 
transition. Also assume that the correlation and response 
functions are associated to an order parameter. Then, 
the scaling form of the response function depends, for 
an infnite system, on the correlation length. However, if 
the system is finite the correlation length saturates, very 



close to the transition temperature, to L. In this case 
the response function in the frequency domain acquires 
the following scaling form [28] 

X{uj) = L^-'^FiujL') = N'-^FiiuN'/"^), (22) 

where F(x) and Fi(x) are scaling functions, z is the dy- 
namic exponent, d is the spatial dimension and 77 cor- 
responds to anomalous dimension exponent. From the 
previous analysis one sees that 

/OO J 
^x(c^), (23) 

2 — 7] 

which leads to tox(O) — BN^^ , where the constant 
B — v"^ T^^Fiix). Then we should have, if the 
general arguments we have developed before apply, that 
(7^_(A^,^)) (iA^Tr)-i. It is worth noting that we 
must demand 2 — 77 > 0. This result is already different 
from the general law given by Eq. (7). Furthermore, it 
could even suggest that in this case the analysis leading 
to (7) is incorrect because fluctuations are so important 
that one can no longer assume that there is an small time 
Tc such that for t > Tc the system does not violate the sec- 
ond law, which implies that using the small t expansion 
for mx is no longer correct. This fact could also affect 
the scaling form in the time variable. In other words, 
the previous theory breakes down since the typical relax- 
ation time of the system diverges in the thermodynamic 
limit. Finally, note that in the mean- field case (where 
77 = for a scalar field) fluctuations are naturally unim- 
portant. In this case the analysis leading to (7) is correct 
and one should have different scaling forms with TV de- 
pending only on the spatial dimension in the vicinity of 
a phase transition (TZ ~ (tTV^/'')^^), while far away from 
the phase transition (7) should hold. 

In conclusion, we have introduced a general set of ar- 
guments to predict that for generic ergodic systems satis- 
fying the fluctuation relations, the mean fraction of time 
the systems spends violating the second law of thermo- 
dynamics within a single trajectory scales, in the large-t - 
large- A'' limit, as {t'/N)~^ . This result could be useful for 
miniaturization purposes. We tested our theory in a sim- 
ple system, both, analytically and numerically, finding a 
good agreement with the predicted scaling. We point out 
that non-ergodic systems, as well as systems where fluc- 
tuations are strong (as in the vicinity of a phase transi- 
tion) may violate this simple scaling law. It would be in- 
teresting to compute the full distribution of the violation 
ratio to elucidate if some symmetry relation (reminiscent 
of the FTs) arises. On the other hand, a precise study of 
this distribution in the thermodynamic limit could give 
direct information about how the divergence of a relax- 
ation time affects the second law of thermodynamics. 
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